Comparing automatically detected reflective texts with human judgements
نویسندگان
چکیده
This paper reports on the descriptive results of an experiment comparing automatically detected reflective and not-reflective texts against human judgements. Based on the theory of reflective writing assessment and their operationalisation five elements of reflection were defined. For each element of reflection a set of indicators was developed, which automatically annotate texts regarding reflection based on the parameterisation with authoritative texts. Using a large blog corpus 149 texts were retrieved, which were either annotated as reflective or notreflective. An online survey was then used to gather human judgements for these texts. These two data sets were used to compare the quality of the reflection detection algorithm with human judgments. The analysis indicates the expected difference between reflective and not-reflective texts.
منابع مشابه
The GREC Challenges 2010: Overview and Evaluation Results
There were three GREC Tasks at Generation Challenges 2010: GREC-NER required participating systems to identify all people references in texts; for GRECNEG, systems selected coreference chains for all people entities in texts; and GRECFull combined the NER and NEG tasks, i.e. systems identified and, if appropriate, replaced references to people in texts. Five teams submitted 10 systems in total,...
متن کاملEvaluating humorous properties of texts
The success of a humour-generation program is usually assessed by having human judges rate texts. However, there has been little consideration of the patterns shown by such judgements, particularly in terms of consistency. We present two small studies which attempt to gauge the consistency of human judgements about humorous aspects of texts, and discuss some of the methodological issues involved.
متن کاملReflective Learning and Teaching: A Review
Introduction: One of the most important characteristic of human being is his ability to learn. Structuralists believe that learning is an active process through which learners explores the principles, meanings and facts by themselves. Learner’s participation in learning process is one of the active learning strategies and reflective learning is considered as an active teaching method which is i...
متن کاملThe Open University ’ s repository of research publications and other research outputs Keywords of written reflection - a comparison between reflective and descriptive datasets
This study investigates reflection keywords by contrasting two datasets, one of reflective sentences and another of descriptive sentences. The loglikelihood statistic reveals several reflection keywords that are discussed in the context of a model for reflective writing. These keywords are seen as a useful building block for tools that can automatically analyse reflection in texts.
متن کاملKeywords of written reflection - a comparison between reflective and descriptive datasets
This study investigates reflection keywords by contrasting two datasets, one of reflective sentences and another of descriptive sentences. The loglikelihood statistic reveals several reflection keywords that are discussed in the context of a model for reflective writing. These keywords are seen as a useful building block for tools that can automatically analyse reflection in texts.
متن کامل